Dense memory with high order neural networks
نویسندگان
چکیده
منابع مشابه
High Order Neural Networks for Efficient Associative Memory Design
We propose learning rules for recurrent neural networks with high-order interactions between some or all neurons. The designed networks exhibit the desired associative memory function: perfect storage and retrieval of pieces of information and/or sequences of information of any complexity.
متن کاملNeural networks with high-order connections.
We present results for two different kinds of high order connections between neurons acting as corrections to the Hopfield model. Equilibrium properties are analyzed using the replica mean-field theory and compared with numerical simulations. An optimal learning algorithm for fourth order connections is given that improves the storage capacity without increasing the weight of the higher order t...
متن کاملChaotic Dynamics of High Order Neural Networks
The dynamics of an extremely diluted neural network with high order synapses acting as corrections to the Hopfield model is investigated. As in the fully connected case, the high order terms may strongly improve the storage capacity of the system. The dynamics displays a very rich behavior, and in particular a new chaotic phase emerges depending on the weight of the high order connections ε, th...
متن کاملSensory Cue Integration with High-Order Deep Neural Networks
Humans can easily capture real world concepts from multi-modal signals by constructing joint representations of these signals. The joint representations may contain abstract information of multiple modalities and relationships across the modalities. Contrary to humans, it is not easy to obtain joint representations reflecting the structure of multimodal data with machine learning algorithms, es...
متن کاملNeural networks for short-term memory for order differentiate high and low proficiency bilinguals
Short-term memory (STM) for order information, as compared to STM for item information, has been shown to be a critical determinant of language learning capacity. The present fMRI study asked whether the neural substrates of order STM can serve as markers for bilingual language achievement. Two groups of German-French bilinguals differing in second language proficiency were presented STM tasks ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied Mathematics Letters
سال: 1990
ISSN: 0893-9659
DOI: 10.1016/0893-9659(90)90072-j